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INTRODUCTION 

This evaluation report presents data co»niled for the three 
years of operation of the title vii project in Caaden. New 
Jersey. Originally planned as a three, year project coB»encing in 
Septeaber 1984 and continuing through Septeaber 1987. the project 
has been extended for an additional two years. It has been funded 
in part by the Caaden Board of Education and in part by the U.S. 
Department of Education. Bilingual Grant Prograa under title vii 
of the Eleaentary and Secondary Education Act (ESEA) as aaended 
by P.L. 98-511 (C.F.D.A. 84.003C). This project has been designed 
tp provide suppleaentary educational services to Indochincse 
students in grades 6-12 who have been identified as Halted 
English proficient (LEP). 

This report is divided into three sections. The first 
section briefly describes the project coaponents and objectives. 
Because of the continuity of the project during its three years 
of ope '•at ion. the project compouents have remained generally the 
sane. However, there have been slight modifications to account 
for clarification and changes in the editions of certain testing 
instrument Readers who wish a fuller description of the project 
coaponents and objectives are referred to YEAR ON!- PROGRESS 
REPORT and YEWl TWO PROGRESS REPORT. This section also includes 
suaaary descriptive data about the project staff and 
participants . 
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In reviewing the sujiBative data, some errors in tabulating 
nuBbers of participants by grade leveU were uncovered. These 
errors appear in the Year One Progress Report and the Year Two 
Progress Report. These errors have been corrected in this report. 
Therefore, any differences in the number of participants reported 
by grade level between the progress reports and this report are 
the result of earlier tabulation errors. 

The second section of this report describes the methodology 
and process eapioyed by the evaluetoit's in deteraining the 
effectiveness of the project in achieving its objectives. It 
further presents the findings of the research study and provides 
discussion of the findings. 

The third section of the report presents some conclusions 
about the success of the project and offers recoroaendations for 
future efforts. 

As has been indicated in previous progress reports, the term 
"Indochinese" has been used throughout this report to describe 
the project participants. T^i8 term has been used with the 
knowledge that a great many linguistic and cultural differences 
exist among the Vietnamese. Cambodian, Laotians. Hmong, and other 
peoples from the Indochinese peninsula of southeast Asia. 
Understanding that the project participants represent these 
different ethnic and cultural groups, the term "Indochinese" has 
been used because it seems to be the only appropriate term to 
refer to the target population. 



Throughout this evaluation report, the teris "project" and 
"progran" are used when referring to those services and 
activities for Indochinese students. These terms have been used 
interchangeably. 
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PERSPECTIVE 

Aaerican educators face a great aany difficulties in 
educating Indochinese students. Besides the linguistic and 
cultural differences which exist among the Vietnamese. Caabodian 
and Laotian peoples, their native educational systems and. to a 
great extent, their prior early education nave been vastly 
different from that of Aaerican society. 

When the first major wave of Indochinese I mostly Vietnamese) 
refugees arrived in America in 1975-1976. most of them had 
already been educated. Adults felt very strongly about the 
education of their children and took the necessary steps to 
ensure that their children were enrolled in private or public 
schools. For the most part, these refugees were among the social, 
political and military elite in their countries or they worked in 
sensitive positions for the U.S. government. Because of this, 
they were able to afford the costs I both financial and otherwise) 
of attending (or sending their children to) school. However, as 
the waves of iamigration continued, the type of immigrant 
changed. Many of the new refugees were poorer and less educated. 
Instead of flying out of their homelands in commercial, private, 
or military aircraft, thousands escaped in small boats and 
reached the relative safety of other ports only after surviving 
the horrors and deprivations of the open seas. The "boat people 
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were far less fortunate than their earlier counterparts. In fact, 
many of the students now attending elenentary and secondary 
schools In Aierica had never known what a real "classroom" was 
until they arrived in the United States. For sose of the youngest 
students, even their parents «ay have received little or no 
formal (or infornal) education in their own language. For many, 
their only educational experience was that which they may have 
received in the jungle refugee camps in Indonesia or on the 

Thailand border. 

As a result, educating these refugee peoples is difficult. 
Most refugees speak little or no English, and many are seai- 
literate or illiterate even in th^ir own language- Some have had 
some education in their native educational systems: many have had 
littlij or no educational experiences. This only serves to 
compound the other problems which these refugees face on a daily 
basis and. in turn, it places an enormous burden on American 
educators . 




SECTION ONE 
PROJECT COMPONENTS AND OBJECTIVES 

l.l Project Conponents 

During the three years of the operation of the project, 
there were six major components: la) instructional assistants 
component. (b) community school coo: dinator component, (c) 
curriculum development component, (d) tutor enrichment component, 
(e) training component. and <f) parent advisory council 
component. A seventh component, native language counseling, was 
also planned. However, despite an active search, the project 
administrator was unable to identify and rec.-uit a suitably 
aualifled Vietnamese (or Cambodian or Laotian) counselor or 
psychologist or a non-Indochinese counselor or psychologist 
fluent in the native language(s). Moreover, there is evidence in 
the literature that suggests that cultural barriers inhibit many 
Indochinese {particularly Vietnamese) from seeking professional 
help foi- stress or emotional difficulties. For these reasons, 
little was accomplished in providing native language counseling 
services • 

(a) Instructional Assistants Component 

The Camden school district provides a basic bilingual 
education support program for Its non-native language students 
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who have been Identified as limited English proficient (LEP). The 
basic support profipraB provides bilingual resource teachers. 
English as a second language teachers (ESL). and an Indochinese 
instructional assistant. The title vii instructional assistants 
suppienent these staff and help to reinforce the skills and 
subject aatter introduced by the regular classrooa teachers and 
the special bilingual/ESL teachers in order to facilitate English 
coRprehension and and application of the material covered. The 
instructional assistants further provide individual help to 
student learners and serve as recognizable role models for the 
Indochinese project participants. Finally, the instructional 
assistanws help to improve the communication channels between 
school district staff and the Indochinese community. 

(b) Community School Coordinator Component 

For the most part. Indochinese parents. particularly 
Vietnamese parents, feel very strongly about the education of 
their children. However, because of cultural differences, these 
parents often avoid becoming involved in the educational process. 
To do so. rhey feel, may be considered intrusive by the teacher 
and thus may cause great embarrassment to all concerned. 
Additionally, the fact that many parents themselves do not speak 
English further inhibits their desire to becr-ne actively 
involved in school affairs. In order to overcome these obstacles, 
the project instituted the community school coordinator 
component . 
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The coMunity school coordinators serve the projc-t by {II 
assisting the bilingua- parent advisory council in achieving its 
objectives. (2) facilitating the process of having parents 
participate in school activities. <3> sensitizing the project and 
school district staff to the needs of a linguistically and 
culturally different student population, and (4) serving as a 
resource to parents and faaiiies needing social, health, or other 
support services. 

(c) Curriculua Development Component 
Because of the differences which exist in the educational 
and cultural systems of the United States and their native 
homelands, many Indochinese students face difficulties with the 
standard curricula. In order to develop and adapt institutional 
objectives, strategies and materials to meet the special needs of 
Indochinese students, both regular classroom and ESL teachers 
researched and developed new curricular guides and materials for 
the required history and civics courses in the high school. In 
1984-1985. the fi*^«- year of the project, three regular school 
district staff, assigned to the title vii project, developed new 
curricular approaches for teaching legal and social education to 
Indochinese LEP students. These approaches and strategies were 
documented in a resource guide for instruction which was then 
approved by the school district's curriculum cosaittee and the 
Board of Education. Similarly, in the second year of the project, 
new curricular approaches and strategies were developed for the 
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teaching of U.S. history to the Indochinese LEP students. 
Finally, during the third year of the project, a new curricular 
prograii ma r^eveloped for teaching the history and culture of 
southeast Asia. 

(d) Tutor Enrichaent Conponent 

The tutor enrichment component was designed to provide 
Indochinese LEP students with an additional opportunity to 
improve their linguistic and acadeaic skills by engaging a native 
language tutor to assist In their studies. Furtheraore. such 
tutors serve as additional role models for students to help 
mitigate social and cultural problems these students may 
encounter. 

The tutor enrichment component enlisted Indochinese students 
in grades 9 - 12 in Woodrow Wilson High School to tutor students, 
individually and in small groups, in K-8 in the Craiaer Elementary 
School and the East Camden Middle School. During the first year 
of the project in 1984 - 1985. twelvr Indochinese high school 
students conducted a total of 245 sessions, or an average of 20.4 
sessions per tutor. These sessions were attended by 45 elementary 
and middle school pupils. During the second year of the project 
in 1985 - 1986. the number of tutors increased to seventeen and 
the nu«ber of tutoring sessions increased to 516, or an average 
of 30,4 sessions per tutor. These sessions were attended by 51 
elementary and middle school pupils. Finally, in the third year 
of the project in 1986 - 1987. a total of eleven Indochinese high 
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school students provided 338 tutorinti sessions, or an average of 
29.8 sessions per tutor. These sessions were attended by 19 
elementary and aiddle school pupils. 

(e) Training Cosponent 

The purpose of this component was to provide training to the 
various population groups involved in the project including 
regular classroom teachers. bilingual/ESL teachers, 
administrative and support staff and parents. Training was 
provided in: (1) the histories and cultures of the Indochinese 
countries, (2) the linguistic characteristics of the Indochinese 
students. (3) the diagnosis and prescription for specific 
education problems, and (4) the philosophy and methods of 
educating second language learners. Training for parents focused 
primarily on instruction in the English language. 

Training was provided in a variety of ways. First, formal 
training was provided by Professor Nguyen Ngoc Bich of the 
Bilingual Education Service Center at Georgetown University. 
Sessions were conducted in cultural awareness and sensitivity, 
native culture and customs, and integrative seond language 
strategies with subject/grade level curriculum, schemata, and 
theory/cognitive networking. These sessions were videotaped and 
televised on local cable television channels. (These videotapes 
have also been reproduced and are available for dissemination to 
other school districts and project locations). These sessions 
appear to have been effective as evidenced by the consultant's 
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report of satisfaction by particlt*ants. 

Sensitivity to the cultural differences was also provided 
for school district staff by the Indochinese comunlty. This was 
accomplished during the second year of the project when a number 
of Indochinese parents and students provided a valuable cultural 
experience for the district's instructional and administrative 
staffs (as well as for each other) in the form of a New Year's 
celebration. During this festive occasion, nearly 150 Vietnamese. 
Cambodian, and Laotian parents and students exhibited native 
dress, explained cultural and religious practices, displayed 
native artistic pieces, demonstrated native darces. and sampled 
native dishes. The comaients made about the value of the event as 
a cross-cultural experience suggest that they are important 
contributing factors to the acculturation of the Indochinese 
refugees . 

(f) Parent Advisory Council Component 

Indochinese parents were encouraged to participate in the 
school district's bilingual parent advisory council. Meetings 
were held during the regular academic year on a monthly basis 
(September - May). Topics such as general cultural and 
educational concerns, desegregation, school rules, health care, 
social services and others were discussed. These sessions proved 
valuable not only for the information that was exchanged but also 
for the opportunity parents had to meet and interact with people 
from other minority groups. Moreover, the council meetings helped 
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Indochinese parents to learn more about the schools and to 
understand better what their children were learning. 

1.2 Project Objectives 

The overarching goal established for the title vii project 
students was for thea to achieve a level of fluency in English 
that would enable thea to learn in a regular classroom 
environaent, to coaplete their education and. ultimately, to 
function effectively in American society. It was expected that, 
with the regular bilingual program and the suppleaentary 
assistance provided by the title vii project. Indochinese 
students would become functionally fluent in English, achieve at 
least the minimum standards on the New Jersey graduation test 
(MBS or HSPT). and earn a high school diploma upon graduation. 
Specific objectives to meet this goal were as follows. 

At the conclusion of the three year title vii project, at 
least 75* of the Indochinese LEP students in grades 6-12 would: 

1. achieve English language proficiency by scoring at or 
above the appropriate grade level cut-off of the New Vork 
Language Assessment Battery (LAB). 

2. show improvement in English reading and language 
(writing) skills as measured by the Comprehensive Test of Basic 
Skills (CTBS). 

3. show improvement in computational skills as measured by 
the Comprehensive Test of Basic Skills (CTBS). 

12 

17 

ERIC 



4. achieve a passing grade on the New Jersey Miniaua Basic 
Skills Test IMBST) or the High School Proficiency Test (HSPT). 

5. successfully coaplete required courses for high school 
graduation by meeting miniraum curriculua proficiencies 
established for each course at the high school level. 

The instruaents used to measure these objectives are fully 
discussed in the Year One Progress Report. They include the New 
York Language Assessaent Battery (LAS), which is used to measure 
English language proficiency. This test is reported by its 
developers to be both valid and reliable and its use in bilingual 
projects is encouraged by the New Jersey Departnent of Education. 
The Conprehensive Test of Basic Skills (CTBS) is widely used to 
assess achieveaent in reading and mathematics. Subtests In 
vocabulary and reading comprehension produce a total reading 
score, and subtests in language mechanics and language expression 
produce a total language score. Finally, subtests in math 
computation and math concepts and applications produce a total 
mathematics score. Subtests are generally administered as part of 
a battery of testings over a period of time. The test developer. 
CTB/McGraw Hill, reports the test to be both valid and reliable 
for measuring achievement in the basic skills commonly found in 
state and local curricula in grades K - 12. Scores are offered in 
a variety of forms. The CTBS has been adopted by the school 
district of Camden as its dl-trict-wide testing instrument. 

The English as a Second Language proficiency test (Marano 
Test of Passive Grammar) is a written test designed to assess 
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students' abilities to identify grawiatically correct English 
sentences and phrases. Infonaation of validity and reliability of 
this test WIS not readily available. It should be noted, however, 
that the Marano Test was originally used fo) an English as a 



Second Language prograa at Glassboro State College and is 
accepted as both valid and reliable by the New Jersey Departaent 
of Education. Scores are offered in a variety of foras on two 
levels of the test. 

The Sew York LAB is administered to students upon their 
identification as students whose native language is other than 
English to assess their readiness to function in an English 
doainant classrooa. The CTBS is the district-wide achicveaent 
test administered to all Caaden students in the Fall and Spring 
of each acadeaic year. The ESL Marano Test is adoinistered un a 
pre/post basis in the Fall (or upon entry into the bilingual /ESL 
prograa) and Spring seaesters of each acadeaic year. 

Project administrators use the above test instruaents, as 
well as final grades. to determine Indochinese students' 
readiness to exit the title vii project and to be mainstreamed to 
regular English-dominant classrooas. In order to be mainstreaaed, 
a student aust demonstrate satisfactory achievement on all of 
these instruaents. District staff feel strongly that. in 
measuring overall title vii project success, it is important to 
note the number of Indochinese students, both elementary and 
secondary, who are ab!e to be mainstreamed to regular classrooms. 
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1.3 SUMiary Descriptive Project Data 

The niuibers of project participants and staff in the three 
years of project iaplementation are shown In the following 
tables. 

Table l' 
Title VII Project 
Grade Level and Ethnic/Cultural Identification of Participants 

1984-85 through 1986-87 

Ethnic/Cultural Identification 
Grade Vietnanese Canbodian Laotian Total 



Level 
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87 
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86 


87 
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12 
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10 
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6 


10 


5 
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11 
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6 






1 
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0 


1 


1 


0 


2 
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9 


7 






5 


1 


5 


3 


0 


0 


1 


0 


1 


9 


1 


6 


8 






10 


3 


2 


3 


3 


2 


0 


1 


0 


13 


7 


4 


9 






2 


10 


7 


0 


4 


3 


1 


0 


1 


3 


14 


11 


10 






6 


3 


8 


2 


1 


3 


1 


0 


0 


9 


4 


11 


11 






11 


4 


4 


0 


1 


1 


2 


0 


0 


13 


5 


5 
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1 


4 


4 


0 


0 


1 


0 


0 


1 


1 


4 


6 


TOTAL 


{6- 


12) 


36 


33 


39 


8 


9 


10 


6 


2 


3 


50 


44 


52 


TOTAL 


(K- 


12) 


79 


86 


76 


12 


16 


23 


11 


5 


3 


102 


107 


10! 
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Table 2 
Title VII Project 
Description of Project Staff. Functions, and Funding Sources 

1984-85 through 1986-87 



Function or Ti^le Number Title State/Local Other 

of Staff Assigned VIl Funding Funding 

85 86 87 85 86 87 85 86 87 85 86 87 

Project Director 111 XXX XXX 

Bilingual 
Resource 

Teachers 2 2 2 XXX 

Instructional 

Asaistant(s) 222XXX XXX 

Coawunity School 

Coordinators 12 1 XXX 

Teacher Super- 
visors for 

Tutors 3 3 3 XXX 

ESL Teachers 6 6 6 XXX 

Curriculun 
Devalopaent 

Teachers 3 3 3 XXX 

Project 

Secretary 111 XXX XXX 
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SECTION TWO 
STUDY METHODOLOGY AND FINDINGS 

2 . 1 Study Methodology 

The study approach has several liaitatlons. While the 
evaluators did provide input into the project design and did have 
the opportunity to assist in the developnent of the project 
objectives, to review the project first-hand through a day of on- 
site visits to project classrooms, and to discuss the project's 
services and activities with the staff, this evaluation re«alns 
essentially a post hoc evaluation. There has been no attempt on 
the part of the evaluators to conduct formative evaluation or to 
study in-depth the relevance or substance of the curriculum. 
Furthermore, the selection of test instruments was made by 
district administrators and, other than the comments that have 
been made in the Year One Progress Report about the design 
features of certain of the testing Instruments, no attempt was 
made to study the relevance of the Instruments to the target 
population. 

Consequently, the evaluators have limited themselves to 
assessing project effectiveness based upon four factors: (1) 
information obtained from the project director and through on- 
site observations, (2) a review of available district records. 



(3) a review of available standardized and other test data* and 

(4) a survey of project and district staff. The evaluation 
approach t therefore, rests principally on an assessment of the 
extent to which the project objectives were achieved as measured 
by standardized and other test data ana the extent to which 
project staff were satisfied with the project's services and 
activities. Readers are advised, therefore, that any conclusions 
drawn about the effectiveness of the project have been drawn 
within the context and limitations of this approach. 

2.2 Evaluative Questions 

In assessing the effectiveness and success of the three 
years of laplementation, the project ^s proper context must be 
understood and Maintained. 

The title vii project is primarily a supplementary sersrices 
project and not a direct instructional services one. 
Consequently, effectiveness and success should be measured in 
terns of the services offered and not solely in terms of student 
achievement. Where student achievement data have been available, 
they have been reviewed and analyzed. However, there exist many 
variables that relate to student achievement not only in English 
language proficiency but also in reading, language (writing), and 
aatheaatics skills. Such variables all influence achievement in 
one way or another. The evaluators have made no attempt to 
isolate, control, or manipulate any intervening variables which 
may influence student achievement. Finally, no conclusions can be 
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drawn which Infer a direct causal relationship between the title 
vil project and increases (or decreases! in English language 
proficiency. reading. language (writing). or aarheaatics 
achievenent . 

A review of the perfornance objectives as stated iu the 
project application has proapted the following evaluative 
questions : 

TO WHAT EXTENT HAVE THE PROJECT OBJECTIVES BEEN ACHIEVED? 

1. To what extent were title vli services/activities 
provide^i? 

2. To what extent has the English language proficiency of 
project participants improved as evidenced by test data? 

3. To what extent have project participants demonstrated 
improvenent in reading and language (writing) as 
evidenced by standardized ^est data? 

4. To what extent have project participants dewonstrated 
ioproveaent in computational skills as evidenced by 
standardized test data? 

3. To what extent have project participants met the minliauin 
standards for graduation in reading, writing and 
mathematics in English? 

6. To what extent have project participants achieved 
progress toward earning high school diplomas? 

7. How do project participants compare with an appropriate 
non-project comparison group in reading and mathematics 
achievement? 

8. What other measures of program success have been 
demonstrated? 

9. To what extent have the services and activities been 
perceived by project staff as effective? 
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2.3 Findings and Discuss. on 

In this section, the findings of the evaluation study are 
presented and discussed. Whenever and wherever necessary and 
practical. the discussion is supported by e«pirical data 
collected and conpiled by the project staff and aade available to 
the project evaluators. 

Evaluative Question #1 - To What Extent Were Title VII Services 
and Activities Provided? 

During the first year of impleaentation. the project had 
achieved all of the aanageaent objectives that had been 
established. This included identifying project participants, 
hiring instructional staff, appointing cooperating teachers, 
selecting high school tutors, initiating and conducting training 
workshops. selecting curriculuw consultants, and initiating 
parent activities. During the succeeding years of project 
iapleaentation . these activities continued to be provided. 

As table 1 indicates (see page 15). a total of 146 
{triplicated count), hidochinese LEP students in grades 6-12 
participated in the project during its three years of 
iapleaentation. In addition, another 165 (triplicated count) 
Indochinese students in grades K-8 were served indirectly by 
project services. In addition to the project director, the 
project was served by bilingual resource teachers, instructional 
assistants, conaunity school coordinators, teacher supervisors. 
ESL teachers, curriculum development teachers, and a project 
secretary. 
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Instructional assistants and coaaunity school coordinators 
assisted participants and their parents by helping in the 
classroon and by helping to coordinate educational and 
social /health services. 

During the three years of project iaplenentation. curriculum 
developers developed neu curricular guides, specifically designed 
for Indochineae LEP learners, for teaching social and legal 
education, Aaerican history and the history of southeast Asia. 

Tutors froa Woodrow Wilson High School provided tutoring 
services to Indochinese in grades K-8 in the Craaer Elementary 
and East Camden Middle schools. During the three year period of 
the r reject. 40 {triplicated count) Indochinese high school 
students provided 1.089 tutoring sessions for 113 (triplicated 
count) eleaentary and middle school LEP students. 

Training workshops and parent advisory council meetings were 
held during the three years of project implementation to bridge 
the cultural gap that exists between the Indochinese and other 
cultural and ethnic groups in Camden City. 

Evaluative Question #2 - To What Extent has the English Language 
Proficiency of Project. Participants Improved as Evidenced by Test 
Data? 

In responding to this evaluative question, the evaluators 
continued the exacination. begun two years earlier, of two 
primary data sources: the New York Language Assessment Battery 
(LAB) and the ESL Marano Test of Passive Grammar. 

The New York LAB is used primarily as an entry/exit test 
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Instruaent: students, therefore, are not routinely tested with 
the LAB. The Narano Test, on the other hand, is administered 
annually on a pre/post basis. 

Several factors concerning the New York LAB have aade the 
analyzing of its data complicated and somewhit difficult. As has 
previously been stated, the LAB is administered only on a 
entry/exit basis.. As a result, project participants who leave the 
project unexpectedly are not tested and, therefore, a large 
number of students who bad been in the project have entry (pre) 
but no exit (post) scores. Second, some of the participants who 
were in grades 6 and 7 during the 1984-8S and 1985-86 p 'Ject 
years were tested with the 1976 edition of the LAB. and their 
scores are reported in percentile rankings. About midway through 
the 1985-86 academic year, the 1976 edition of the LAB was 
discontinued in favor of the updated 11982) edition. Data 
resultant from this edition have been presented in raw scores, 
thus making comparative analyses more difficult. Because the 1982 
edition does not provide for the conversion of scores, the New 
Jersey Department of Education established new guidelines for 
acceptable performances on the LAB and published cut-off scores 
in raw score format. In order to be consistent, immediately prior 
to the third year of the project, title vii administrators 
revised the performance objective to coincide with the raw score 
cut-offs established by the state. 

What has occurred, therefore, has made the analysis of LAB 
scores diificult. Not only has the instrument and the way in 
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which data are reported changed, but the performance objective 
and the »iniau« acceptable standards have also been revised. 

Because of these difficulties in analyzing ^ew York LAB data 
and because the school district combihos data frora a variety of 
sources when assessing language coapetencies. the evaluators have 
decided to assess English language proficiency in a manner 
consistent with the district. 

As indicated above. in order to be mainstreamed. an 
Indochinese LEP student must desonstrate English language 
proficiency as leaaured by a nuraber of tests (for more 
inforaation on exit criteria, readers are referred to Appendix A 
to this report). In order to assess proficiency, therefore, the 
evi uators reviewed archival data and calculated the number of 
Indochinese LEP students who were mainstreamed in each of the 
three years of project iapleaentation. Because such competency is 
a prerequisite for nainstreaming. all Indochinese LEP students 
who were moved to regular classrooms can be presumed to be 
proficient in English. Conversely. Indochinese LEP students who 
have not yet been mainstreamed can be presumed not yet to have 
achieved English language proficiency. 

Student data on mainstreaming are presented in the fol lowing 
table. 



23 



Grade 



Table 3 
Title VII Project 
Indochlnese LEP Students Nainstreaned 
Grades 6-12 
1984 - 1987 

Nunber of Stu.dents Malnstreaaed 

1984-85 1985-86 1986-87 



6 
7 
8 
9 
10 
11 
12 



0 
0 
0 
0 
0 
0 
0 



4 
0 
0 
1 
1 
1 
0 



3 
0 
0 
0 
5 
2 
0 



Total 



10 



It should be noted that aost students who entered the 
project in 1984-85 spoke very little English and. therefore, had 
very little chance of learning in a regular classroow 
environment at that time. 

Data froa the ESL Marano Test of Passive Grammar have been 
compared across the three years of project irapU lentation. 
Readers are advised, however, that a basic assumption has been 
made in comparing these data froia one year to the next: that 
there is an acceptable correlation between the Level 100 and 
Level 200 tests. The Level 200 test contains more difficult 
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passages, and differences in the percentages of correct responses 
fro« one level to another may be related to the degree of 
difficulty. Moreover, while students aay have recorded a higher 
percentage of correct responses on the Level 100 test than on the 
Level 200 test. readers are advised that this does not 
necessarily mean that they regressed in English language 
coapetency . 

In 1984-85. raatched pre/ post data on the Marano Test were 
available for 33 Indochinese LEP students in grades 6-12: in 
1985-86, there were matched scores for 34 students: in 1986-87, 
there were matched scores for 44 students. These data are 
presented in the following table. 

Table 4 
Title VII Project 
ESL Marano Test of Passive Graaaar 
Group Matched Pre/ Post Mean Scores 
Percentage of Correct Responses 
1984-1987 



1984-85 1985-86 1986-87 



Grade 


N 


Pre 


Post 


Diff 


N 


Pre 


Post 


Diff 


N 


Pre 


Post 


Diff 


6 


1 


68 


70 


-2 


7 


41 


64 


-23 


8 


48 


62 


^14 


7 


4 


28 


48 


-20 


0 


0 


0 


0 


5 


51 


60 


-9 


8 


12 


46 


58 


-12 


7 


34 


56 


-22 


4 


35 


68 


-33 


9 


2 


37 


54 


*17 


12 


54 


61 


-7 


9 


39 


58 


-19 


10 


6 


56 


66 


-10 


2 


48 


53 


♦5 


13 


51 


63 


-12 


11 


7 


54 


71 


-17 


3 


53 


66 


-13 


3 


57 


57 


0 


12 


1 


46 


46 


0 


3 


55 


71 


^16 


2 


60 


70 


-10 



Note: All mean scores have been rounded to the next highest integer 
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As the data in the above tab.'e indicate, there has been a 

general increase every year in the percentage of itens answered 

correctly by Indochinese LEP students. This suggests that these 

students have continued to increase their English language 

proficiency to the extent that proficiency is actually aeasured 

by the test. However, readers are advised that this inference is 

based on saall numbers of students and. as often is the case. 

Inferences based on ssall numbers raay not be statistically valid. 

Evaluative Question tS- To What Extent Have the Project. 
Participants Deaonstrated laprovenent in Reading and Language. 
(Writing) as Evidenced by Standardized Test Scores? 

Achieveaient in reading vocabulary, reading conprehension and 
total reading have been assessed by the Coaprehensive Test of 
Basic Skills. The CTBS is a district-wide achievement test 
administered to all public school students in the Fall and Spring 
of each academic year. 

For pre/post analysis, matched scores for grades 6-12 in 
reading vocabulary, reading comprehension and total reading were 
available for 29 Indochinese LEP students in 1985-86 and for 37 
students in 1986-87. Matched pre/post data were not available for 
a sufficient number of students in 1984-85 to warrant analysis. 
These data are presented in the following tables. 
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Table 5 
Title VII Project 
Matched Group Pre/Post CTBS Means (NCE's) 
1985-86 and 1986-87 
Reading Vocabulary 







1985-1986 




1986-1987 




Grade 


N 


Pre 


Post Dlff 


N 


Pre 


rOSt 




6 


5 


31 .6 


47.8 16.2 


10 


27.7 


35.1 


7.4 


7 




No Students 


5 


21.6 


27.6 


6.0 


8 


7 


12.7 


16.7 4.0 


4 


21.3 


22.8 


1.5 


9 


9 


12.8 


16.9 4.1 


6 


14.7 


34.0 


19.3 


10 


2 


15.0 


10.5 -4.5 


8 


16.5 


26.3 


9.8 


11 


2 


13.5 


2.0 -11.5 


2 


1.5 


23.0 


21.5 


12 


4 


15.3 


23.0 7.7 


2 


8.5 


20.5 


12.0 



The data in the above table indicate that, in general. 
Indochinese LEP students continued to demonstrate gains in 
reading vocabulary. In fact, when exaaining the different grade 
cohorts, there have been increases in NCE pre/post gains in every 
grade except the 1985-86 sixth grade cohort. For example, in 
1985-86. the mean pre/post difference for eighth graders was 4.0 
NCE's. In 1986-87. however, the mean pre/post difference for 
ninth graders (a year later, most eighth graders had advanced to 
ninth grade) was 19.3 NCE's. For the 1985-86 ninth grade cohort, 
the mean difference increased from 4. 1 NCE's to 9.8 NCE's. For 
the 1985-86 tenth grade cohort, the mean difference increased 
from -4.5 NCE's to 21.5 NCE's. Finally, for the 1985-86 eleventh 
grade cohort, the mean difference increased from -11.5 NCE's to 
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12.0 NCE's. 

These data sugeest that between 1985-86 and 1986-87. 
Indochlnese LBP students performed very well tn reading 
vocabulary, especially in grades eleven and twelve. 

The following table presents data resultant froa the reading 
coaprehension subtest of the CTBS. 

Table 6 
Title Vli Project 
Matched Group Pre/Post CTBS Meiins INCE's) 
1985-86 and 1986-87 
Reading Comprehension 







1985-1986 






1986- 


1987 




Grade 


N 


Pre 


Post Diff 


N 


Pre 


Post 


Diff 


6 


5 


31 .2 


35.8 4.6 


10 


29 


,6 


37 


. 1 


7.5 


7 




No 


Students 


5 


24 


.4 


39 


.0 


14.6 


8 


7 


19.9 


13.9 -6.0 


4 


21 


.3 


30 


.0 


8.7 


9 


9 


23.2 


19.0 -4,2 


6 


22 


.7 


13 


.8 


-8.9 


10 


2 


27.5 


4 . 0 -23.5 


8 


13, 


.8 


13 


.5 


-2.3 


11 


2 


16.5 


11.0 -5.5 


2 


12 


.0 


11 


. 5 


-0.5 


12 


4 


21 .3 


8.3 -13.0 


2 


8 


.0 


12 


.0 


4.0 



Problems in reading comprehension continued to be 
demonstrated in 1986-87 although some improvement was indicated. 
For example, the -6.0 NCE gain demonstrated by the 1985-86 eighth 
grade cohort increased to -8.9 NCE's in 1986-87. In other grades, 
however, there is more optimistic data. The sixth grade cohort 
improved from a 4.6 NCE gain in 1985-86 to 14.6 SCE's in 1986-87. 
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The ninth grade cohort increased froa a -4.2 NCE gain in 1985-86 

to -2.3 NCE '8 In 1986-87. The tenth grade cohort increased froa a 

-23.5 NCE gain in 1985-86 to -0.3 NCE's in 1986-87. Finally, for 

the eleventh grade cohort, the wean gain increased froa -5.5 

NCE's in 1985-86 to 4.0 NCEs in 1986-87. 

The following table presents data on total reading. 

Table 7 
Title VII Project 





Matched 


Group Pre/ Post CTBS 
1985-86 and 1986- 
Total Reading 


Means 
■87 


(NCE's) 










1985-1986 






1986-1987 




Grade 


N 


Pre 


Post Diff 


N 


Pre 


Post 


Diff 


6 


3 


31.0 


39 6 8.6 


10 


27. 


5 


35.6 


8.1 


7 




^'o 


Students 


5 


21 . 


2 


33.4 


12.2 


8 


7 


14.7 


12.0 -2.7 


4 


16. 


8 


23.8 


7.0 


9 


9 


15.3 


14.2 -1.1 


6 


16 


,3 


21.8 


5.5 


10 


2 


17.5 


3.0 -14.5 


8 


13, 


.8 


19.3 


5.5 


11 


2 


16.5 


4.0 -12.5 


2 


2 


. 5 


16.0 


13.5 


12 


4 


17.5 


12.0 -5.5 


2 


7 


.0 


15.5 


8.5 



The probieas encountered by Indochinese LEP students In 
reading coaprehension. especially during 1985-86. were further 
aanlfeated In their total reading scores. However, between 1985- 
86 and 1986-87. scores improved dramatically. For example, the 
1985-86 sixth grade cohort Increased its NCE gains in total 
reading from from 8.6 to 12.2. The eighth grade cohort increased 
its gains froB -2.7 NCE's to 5.5 NCE's. The ninth grade cohort 
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showed Increases from -1 . 1 NCE's to 5.5 NCE's, The tenth grade 
cohort showed increases from -14.5 SCE's to 13.5 NCE's, and the 
eleventh grade cohort showed increases fro« -12.5 NCE's to 8.5 
SCE'8. 

The data froa these tables indicates that the reading 
perfornance objective was achieved. Indochinese LEP students have 
deaonstrated iaproveaent in reading. This improvement has been 
characterized by NCE gains, especially in 1986-87. in the three 
reading subtests of the CTBS. 

The following table provides data resultant from the 
language mechanics subtest of the CTBS. 

Table 8 
Title VII Project 
Matched Group Pre/Post CTBS Means (NCE's) 
1985-86 and 1986-87 
Language Mechanics 

1985-1986 1986-1987 



Grade 


N 


Pre 


Post 


Diff 


N 


Pre 


Post 


Diff 


6 


5 


50.0 


50.8 


8.8 


10 


44.7 


57. 


5 


12.8 


7 




No Students 




5 


28.6 


52, 


4 


23.8 


8 


7 


21 .9 


26.0 


4.1 


4 


28.3 


33. 


8 


5.5 


9 


9 


25.9 


25.4 


-0.5 


6 


37.3 


30. 


7 


-6.6 


10 


2 


15" 5 


15.5 


0.0 


8 


24.6 


34. 


6 


10.0 


11 


2 


22.0 


24.0 


2.0 


2 


13.0 


20. 


,5 


7.5 


12 


4 


20.5 


12.5 


-8.0 


2 


2.5 


15. 


,0 


12.5 



Indochinese LEP students generally did well in language 
mechanics. This is evidenced by demonstrated NCE gains in every 
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grade except the ninth grade (1986-87). The sixth grade cohort 
deaonstrated an increase in gains fro« 8.8 NCE's in 1985-86 to 
23.8 NCE'9 In 1986-87. The eighth grade cohort decreased froa 
4.1 XCE's in 1985-86 to -6.6 SCE's in 1986-87. The ninth grade 

« 

cohort increased froa -0.5 NCE's to 10.0 NCE's. The tenth grade 
cohort increased froa no gain in 1985-86 to a 7.5 NCE gain in 
1986-87. Finally, the eleventh grade cohort increased froa a 20 
NCE gain in 1985-86 to a 12.5 NCE gain in 1986-87. 

The following table provides data froa the language 
expression subtest of the CTBS. 

Table 9 
Title VII Project 
Matched Group Pre/Post CTBS Means (NCE's) 



1985-86 and 1986-87 
Language Expression 

1985-1986 1986-1987 



Grade 


N 


Pre 


Post Diff 


N 


Pre 


Post 


Diff 


6 


5 


32.8 


37.2 4.4 


10 


28. 


0 


37. 


2 


9.2 


7 




No Students 


5 


32. 


8 


41 , 


6 


8.8 


8 


7 


17.1 


9.4 -7.7 


4 


26, 


0 


34, 


8 


8.8 


9 


9 


18.9 


25.0 6.1 


6 


21 


,8 


23 


,7 


1.9 


10 


2 


28.5 


14.5 -14.0 


8 


20, 


, 5 


22 


.8 


2.3 


11 


2 


16.5 


13.0 -3.5 


2 


19 


.0 


17 


.0 


-2.0 


12 


4 


18.0 


10.8 -7.2 


2 


6 


.0 


12 


.0 


6.0 



Siailar gains were reported for Indochinese LEP students for 
language expression. For this subtest, however, the 1985-86 ninth 
grade cohort showed decreases in gains from 6.1 NCE's to 2.3 
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NCE's. Ail other cohorts showed increases between 1985-86 and 
1986-87. The sixth grade cohort increased from 4.4 NCE's to 8.8 
NCE's. The eighth grade cohort increased froi -7.7 NCE's to 1.9 
NCE's. The tenth grade cohort increased from -14 NCE's to -2 
NCE's. Finally, the eleventh grade cohort increased froa -3.5 
NCE's to 6.0 NCE's. 

The following table presents data on total language. 

Table 10 
Title VII Project 
Matched Group Pre/Post CTBS Means (NCE's) 
1985-86 and 1986-87 
Total Language 

1985-1986 1986-1987 



Grade 


N 


Pre 


Post 


Diff 


N 


Pre 


Post 


Diff 


6 


5 


41 . 


4 


48.2 


6. 


8 


10 


36. 


6 


48.5 


11.9 


7 




No 


Students 






5 


29 


,0 


46.6 


17.6 


8 


7 


14. 


3 


15.0 


0. 


7 


4 


23 


.0 


33.8 


10.8 


9 


9 


19 


,2 


24. 1 


4 




6 


28 


.2 


26.3 


-1.9 


10 


2 


19, 


, 5 


14.0 


-5 


.5 


8 


21 


.5 


30.4 


8.9 


11 


2 


19 


.0 


19.5 


0 


,5 


2 


14 


.5 


17.0 


2.5 


12 


4 


18 


.8 


11.5 


-7 


.3 


2 


2 


.5 


11 .0 


8.5 



Total language scores increased for every grade in 1986-87 
except for grade nine where a -19 SCE gain was registered. The 
cohort analyses indicate that every cohort group demonstrated 
increases in NCE gains except the eighth grade cohort. This is 
likely due to the decrease demonstrated in language mechanics for 
this grade cohort. 
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As the above table Indicates, the sixth grade cohort 
increased its gains, from 1985-86 to 1986-87, froa 6.8 NCE's to 
17.6 NCE's. The ninth grade cohort increased its gains fros 4.9 
NCE's to 8.9 NCE's. The tenth grade cohort increased from -5.5 
NCE's to 2.5 NCE's. Finally, the eleventh grade cohort increased 
froai 0.5 NCE's to 8.5 NCE's. 

The data fro» these taLles indicate that the language 
(writing) performance objective was achieved. Indochinese LEP 
students have demonstrated improvement in language (writing). 
This improvement has been characterized by NCE gains on the three 
language subtests of the CTBS . 

In analyzing these data, it is important to keep two things 
in mind. First, the CTBS is an achievement test in which there is 
at least the implied assumption that the test takers speak and 
read English fluently. This may not always be the case with the 
target population. In fact, the very reason that these students 
are receiving supplementary services under title vii is b.'cause 
they neither speak nor read English at acceptable levels. 
Consequently, there may be an unacceptable bias that may confound 
the Interpretation of test data. Second, the data presented in 
these tables are based op snail numbers and inferences drawn from 
small numbers generally are not statistically valid. 

Evalua.tive Question #4 - To What Extent Have the Project 
Participants Demonstrated Improvement in Computational Skills as 
Evidenced by Standardized Test Data? 

Achievement in mathematics has been assessed using the CTBS 
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computational skills battery. Data were available in aatheaatics 
coaputation, uth concepts and applications. and total 
natheMtlcs. For pre/post analysis, aatched data were coapiled on 
these subtests for 29 Indochinese LEP students in 1985-86 and for 
37 students in 1986-87, 

Unlike the data resultant from the reading and language 
subtests of the CTBS. the aatheaatics data show consistent 
declines in the increases made by the various grade cohorts. 

The 1986-87 results show gains for all grades except grades 
10 and 11 for math computation, for all grades except grade 11 
for aath concepts and applications and for total mathematics. 
These data are presented in greater detail in the tables that 
follow. 

Table 11 
Title VII Project 
Matched Group Pre /Post CTBS Means INCE's) 
1985-86 and 1986-87 
Mathematics Computation 

1985-1986 1986-1987 



Grade 


N 


Pre 


Post 


Dlff 


N 


Pre 


Post 


Diff 


6 


5 


80.6 


89.6 


9. 


0 


10 


67. 


8 


69. 


4 


1.6 


7 




No Students 






5 


68. 


0 


72, 


,6 


4.6 


8 


7 


46. 1 


48.9 


2 


,8 


4 


45, 


3 


59 


.8 


14.5 


9 


9 


52. 2 


61 .9 


9. 


7 


6 


49 


0 


54 


.3 


5.3 


10 


2 


50.5 


53.0 


2 


,5 


8 


58 


.8 


57 


.5 


-1.3 


11 


2 


29.0 


39.5 


10, 


,5 


2 


58 


5 


51 


.0 


-7.5 


12 


4 


52.0 


47.5 


-4 


.5 


2 


36 


.0 


38 


.0 


2.0 



While gains in pre/post scores in math computation were 

34 



ERIC 



3D 



registered for aost grades in both 198S-86 and 1986-87. the gains 
were substantially greater in the earlier year. For example, the 
sixth grade cohort showed a decrease in pre/post gains froa 9.0 
NCE's in 1985-86 to 4.6 NCE's in 1986-87. Similar decreases were 
registered in the ninth, tenth, and eleventh grade cohorts. 

The following table provides data resultant fro« the aath 
concepts and applications subtest of the CTBS. 

Table 12 
Title VII Project 
Matched Group Pre/Post CTBS Means (NCE's) 
1985-86 and 1986-87 
Mathematics Concepts and Applications 







1985-1986 




1986-1987 




Grade 


N 


Pre 


Post 


Diff 


N 


Pre 


Post 


Diff 


6 


5 


52.6 


68.4 


15.8 


10 


39.2 


48.7 


9.5 


7 




So Students 




5 


41.8 


49.4 


7.6 


8 


7 


19.6 


21.9 


2.3 


4 


37 .8 


44.3 


6.5 


9 


9 


36.4 


46.7 


10.3 


6 


31 .0 


41.5 


10.5 


10 


2 


42.0 


48.0 


6.0 


8 


47.8 


52.5 


4.7 


11 


2 


28.0 


34.5 


6.5 


2 


48.5 


47.0 


-1.5 


12 


4 


35.5 


30.5 


-5.0 


2 


30.5 


39.0 


8.5 



Like the math computation subtest data, pre/post gains in 
aath concepts and applications were registered in nearly all 
grades both in 1985-86 and in 1986-87. And. as the cohort 
analyses, indicate, these gains decreased from 1985-86 to 1986-87 
except for the eighth grade cohort. In the ninth, tenth and 
eleventh grade cohorts, the pre/post gains registered in 1985-86 
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were greater than those registered in 1986-87. 

The folloifing table presents total matheaatlcs data. 

Table 13 
Title VII Project 
Matched Group Pre/Post CTBS Means (NCE's! 
1985-86 and 1986-87 
Total Mathematics 



Grade 


X 


1985-1986 
Pre Post 


Oiff 


N 


1986-1987 
Pre Post 


Oiff 


6 


3 


65.2 


80.6 


15.4 


10 


52.3 


58.3 


5.8 


7 




No Students 




5 


51.8 


39.0 


7.2 


8 


7 


27.9 


31.9 


4.0 


4 


39.3 


49.3 


10.0 


9 


9 


41.8 


33.9 


12.1 


6 


36.5 


48.2 


11.7 


10 


2 


46.5 


31.5 


5.0 


8 


53.5 


54.9 


1.4 


11 


2 


29.0 


36.3 


7.5 


2 


51 .5 


48.0 


-3.5 


12 


4 


43.0 


38.3 


-4.7 


2 


33.0 


40.0 


7.0 



The pattern Indicated above for math computation and 
concepts and applications is continued in the total Bathematics 
subtest. Except for the eighth grade cohort, the increases in 
pre/post gains were higher in 1985-88 than in 1986-87. It should 
be noted. however. that the NCE gains in 1985-86 were 
substantially higher in math than those registered for reading 
during the saae period: consequently the potential for growth was 
lisiited. 

Nonetheless, the performance objective for computational 
skills was achieved. Indochinese LEP did show Improvement in this 
area as evidenced by the data resultant from the CTBS. 
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iRprovesents were noted In nearly every grade both in 1985-86 and 
in 1986-87. However, the analysis la tempered somewhat by the 
fact that, as the cohort study reveals, the increases in pre/post 
gains in aatheaatics for 1986-87 . were. in some cases, 
substantially smaller than they were a year earlier in 1985-86. 

Evaluative Question #5 - To What Extent Have Project Participants 
Met the Mliiiau* Standards for Graduation in Reading. Writing and 
Matheaatics in English? 

The following standards (or norns) have been established by 
the New Jersey Departoent of Education for basic skills and 
satisfactory perforaance for graduation fro» high school. 
Grade Instrument Subject Area Standard* 

9 High School Proficiency Test Reading 75 

Matheaatics 61 
Writing 77 

10-12 Miniaum Basic Skills Test Reading 75 

Mathematics 65 

• in scaled scores 

Because of the nature of the limited English proficient 
(LEP) students, the requirement for passage of the MBST/HSPT as a 
pre-requlsite for graduation in the Camden City School District 
was waived through the 1988-89 academic year. Consequently, while 
Indochinese LEP students in grades 9-12 were required to take the 
MBST/HSPT test, they were not required to attain a passing grade 
as a condition for graduation. 
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The evaluators researched available records back to 1984-85 

in order to get as clear a picture as possible of MBST/HSPT 

perf oraances . These data are presented in the table below. 

Table 14 
Title VII Project 
MBST and HSPT Scores 
1984-1987 



Student 
So. 

1 

3 

4 

3 

6 

7 

8 

9 
10 
11 
12 
13 
15 
16 
17 
18 
19 
20 
21 
22 
24 
25 
26 
28 
29 
30 
31 
32 



1984-1985 
Read- Writ- 
ing Math ing 



G 



1983-1986 
Read- Writ- 
ing Math ing 



1988-1987 
Read- Writ- 
ing Math ing 



9 
9 
10 
10 
10 
10 
10 
11 
11 
11 
11 
11 



53.2 
56.0 
65.3 
72.7 
52.5 
71.8 
42.0 
67.2 
43.9 
44.8 
42.0 
60.0 



58.5 



56.5 



40.7 
Left 
Left 



9 


32 




59 




57 


9 


59 




(89) 




58 


9 


(85) 








69 


9 


Qj) 








58 


9 


40 




49 




40 


9 


39 




56 




59 


9 


36 




46 




43 


9 


59 




26 




45 


9 


36 




44 




53 


9 


47 




55 




50 


9 


60 








56 


10 


61 . 


4 


80. 


2* 




10 


73. 


6 








11 


73. 


6 


77. 


3* 




11 




J) 








11 


65. 


7 


53 


, 1 




11 












U 


67, 


, 5 








12 


64 


.0 








12 


52 


. 7 








12 


59 


, b 









- M 




12 
12 
12 
12 



- G 

- G 

- G 

- G 



G 
G 
G 



M =■ Malnstreaaed 



G = Graduated 

In table 14 above, the scores that have been circled 

represent passing grades; scores marked with an asterisk (*1 

represent passing scores that have been carried over from a 
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previous year. 

As these data indicate, of the 29 students for whoa data 
Mere available, only four (4) successfully passed the required 
graduation test in both reading and aathenatics . However, nine 
{9) other students passed only the aathematics subtest and one 
student passed only the reading subtest. Technically speaking, 
therefore, the objective of having 75» of the Indochinese LEP 
students achieve passing grades on the New Jersey graduation test 
was not achieved. Nonetheless, it is important to note the 
following inforaation. If the number of students who achieved a 
passing grade on at least one of the subtests were aggregated, 
alaost 45» of the participating Indochinese LEP students would be 
counted. While this is substantially less that the performance 
objective, it does represent soae progress. In 1984-85, only two 
students passed at least one subtest. This nuaber increased to 
six students in 1985-86 and to eight students in 1986-87. 
Moreover, six of the 25 students in the project (two left the 
project in 1984-85 and two more left in 1985-86) were 
aainstreaaed into regular classrooas and seven seniors graduated. 

Consequently, while, technically speaking, the performance 
objective established for the MBST/HSPT was not achieved. 
Indochinese LEP students have made at least soae progress in this 
area. 

Evaluative Question #6 - To What Extent Have Project Participants 
Achieved Progress Toward Earning High School Diplomas? 

As has been indicated earlier in this report, one of the 
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overarching goals of the title vii project Is for participating 

Indochineae LEP students to become sufficiently fluent in the 

English language to function effectively In American society. 

Major benchaarks for the attainaent of. this goal are satisfactory 

perforaances toward high school graduation culninating in the 

awarding of high school diplomas. Such satisfactory performances 

include promotion to the next higher grade, ma inst reaming to a 

regular classroom and, of course, graduation itself. Table 15 

below presents data regarding the number of promotions. 

retentions, mainstreaming and students leaving the district , by 

grade, between 1984-85 and 1986-87. 

Table 15 
Title VII Project 



Participants Promoted 


(P) 


- Retained 
1984 - 


<R) 
1987 


- Ma instr earned 


(M) 




Left 


(L 


G 


N 


1984- 
P R 


-85 

M 


L 


N 


P 


1985- 
R 


-86 
M 


L 


N 


1986 
P R 


-87 
N 


L 


6 


3 


1 


0 


0 


2 


9 


4 


0 


4 


1 


8 


5 


0 


3 


0 


7 


9 


6 


0 


. 0 


3 


1 


1 


0 


0 


0 


5 


4 


0 


0 


1 


8 


13 


12 


1 


0 


0 


7 


7 


0 


0 


0 


5 


5 


0 


0 


0 


9 


3 


2 


0 


0 


1 


13 


11 


0 


1 


1 


12 


9 


0 


0 


3 


10 


9 


7 


1 


0 


1 


4 


3 


1 


1 


0 


13 


5 


0 


5 


3 


11 


12 


4 


0 


0 


8 


6 


5 


0 


1 


0 


4 


1 


0 


2 


1 


12 


1 


1* 


0 


0 


0 


4 


4* 


0 


0 


0 


5 


5* 


0 


0 


0 


Totals 


50 


32 


2 


0 


15 


44 


35 


1 


7 


2 


52 


34 


0 


10 


8 


N = Number 


P 




ProiBoted 


R - Retained 


L ' 


Left 


♦ =. 


Graduate 
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As table 15 indicates, of the 50 Indochinese LEP students in 
grades 6-12 who entered the project in the Fall. 1984. 31 were 
proaoted to the next higher grade and one student was graduated. 
This represents a 66* pronot ion/ graduation rate. In 1985-86. of 
the 44 students who began the project in the Fall of that year. 
31 were prowoted to the next higher grade. 4 students were 
graduated and 6 students were aainstreaaed to regular classrooms. 
This represents a 93.1* pro«5c<^ion/aain8tream/ graduation rate. 
Finally, in 1986-87, of the 52 students who began the project in 
the Fall of that year, 29 were pronoted to the next higher grade, 
five students were graduated and ten students were aainstreaaed 
to regular classrooms. This represents an 84.6* 
proBotion/mainstream/graduation rate. Readers are advised that 
these data may represent triplicated counts: that is. students 
who were counted in 1984-85 may also have been counted in 1985-86 
and 1986-87. 

In analyzing the data over the three year period of project 
iapleaentation. we find that of the 146 students (triplicated 
count) who began the project in the Fall of each year. 25 
students left the project or the district at some point, leaving 
121 students. Of the 121 students who remained. 102 were promoted 
to the next higher grade or were graduated. This represents an 
84.3* promotion/graduation rate. When the 16 students who were 
aainstreaaed are added to this group, the percentage inceases to 
97.5*, well above the performance objective of 75*. 

The performance objective, therefore, of having at least 75* 
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of the participating Indochinese LEP students achieve progress 
toward earning high school diplonas was achieved. In fact over 
97% of all participating students in grades 6-12 were promoted to 
the next higher grade, were mainstreaaed to regular classrooms or 
were graduated. 

It is also interesting to note, although not displayed in 
the data in table 15. that the Indochinese LEP students in grades 
K-5 also enjoyed a substantial promotion/mainstream rate. Of the 
161 students (triplicated count) in grades K-5 who began the 
project in the Fall of each of the three years. 28 left the 
project or district at some point Ip/iving 133 students. Of the 
133 who reialned. 93 were promoted to the next higher grade. 20 
were retained and 20 were mainstreaned to regular classrooBS. 
This represents an 85% proaiot ion/mainstream rate. While these 
eleneKtarv students were not served directly by the project, they 
did benefit from many of the project's components including the 
tutor enrichment component, the training component, and the 
parent advisory council component. This accomplishment, 
therefore, speaks not only to the district bilingual program, but 
also to the title vii project. 

Evaluative. Quest ipn..#7 - How Do Project Participants Compare With 
an Appropriate Non-Project Comparison Group in Reading and 
Mathemat ics Achievement? 

One of the evaluation requirements under CFR 500.50 (b) (1) 
is the assessment of educational progress of project participants 
when measured against an appropriate non-project comparison 

42 



group. In providing the following comparative data, readers are 
advised that all the secondary (grades 6-12) Indochinese LEP 
students In the district are served by the title vii project. 
Furthermore, readers are reminded that the title vii project was 
never designed to be primarily a direct instructional project: 
rather it was designed as a supplementary services project. The 
regular district-sponsored bilingual/ESL program provides the 
primary direct instructional activities to all LEP students, and 
the title vii project is designed to supplement instruction for 
Indochinese LEP students. This notwithstanding, the evaluators 
sought to analyze and compare standardized CTBS pre/post data in 
reading and mathematics on Indochinese LEP students and Hispanic 
LEP students in grades 6-12. These data are presented in the 
tables which follow. 
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Table 16 

Matched Group Pre/Post CTBS Means (NCE's) 
Hispanic and IndocMnese LEP Students 
1986-1987 
Total Reading 



Hispanic Indochinese 

Grade N Pre Post Diff X Pre Post Diff 

6 14 14.6 17.1 2.5 10 27.5 35.6 8.1 

7 10 24.6 19.6 -0.3 5 21.2 33-4 12.2 

8 8 11.3 15.9 4.6 4 16.8 23.8 7.0 

9 8 25.8 29.9 4.1 6 16.3 21.8 5.5 

10 5 24.4 34.2 9.8 8 13.8 19.3 5.5 

11 11 19.2 20.5 1.3 2 2.5 16.0 13.5 

12 6 18.0 25.2 7.2 2 7.0 15.5 8.5 



As table 16 indicates, the mean NCE gains in total reading 
were generally higher for Indochinese LEP students than they were 
for Hispanic LEP students except in tenth grade. While post test 
aeans increased for all grades except grade 7 for the Hispanic 
cohort, post test means increased for all grades for the 
Indochinese cohort. 




Table 17 

Matched Group Pre/'Post CTBS Means (SCE's) 
Hispanic and Indochinese LEP Students 
1986-1987 
Total Mathematics 









Hispanic 






Indochinese 




Grade 


N 


Pre 


Post 


Dlff 


N 


Pre 


Post 


Diff 


6 


14 


26.0 


22.3 


-3.7 


10 


52.5 


58.3 


5.8 


7 


10 


33,5 


30. 1 


-3.4 


5 


51.8 


59.0 


7.2 


8 


9 


26.2 


23.9 


-2.3 


4 


39.3 


49.3 


10.0 


9 


7 


33.6 


40.0 


6.4 


6 


36.5 


48.2 


11.7 


10 


5 


32.8 


33.8 


1.0 


8 


53.5 


54.9 


1.4 


11 


10 


27.3 


30.5 


3.2 


2 


51.5 


48.0 


-3.5 


12 


6 


35.8 


33.0 


-2.8 


2 


33.0 


40.0 


7.0 



Si«iiarly. as table 17 indicates, the oean NCE gains in 
total aatheaatics were higher for the Indochinese LEP students 
than they were for the Hispanic LEP students. Gains were 
registered in only three grades for the Hispanic cohort {grades 
9. 10. 11 >. In contrast, gains were registered for every grade 
for the Indochinese cohort, except grade 11. 

R&aders are reminded, however, of the differences in the 
basic nature and structure of the two programs: the Hispanic 
cohort received direct instruction in the district-sponsored 
bilingual/ESL project, while the Indochinese cohort received both 
direct instructional services in the regular bilingual/ESL 
project and the supplemental title vii project. Because of this. 
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it l8 difficult to isolate the effects of the title vii project. 
Consequently, it is difficult to infer a causal relationship 
between the higher scores registered by the Indochinese cohort 
and the services and activities of the. title vii project. While, 
when taken at face value, it seens reasonable to suggest that the 
supplemental services contributed to the higher scores, in fact, 
these higher scores »ay be attributed to direct instruction 
received in the regular district-sponsored bilingual/ESL progra* 
or to other intervening variables that have not been identified. 

Evaluative Question #8 - What Other Measures of Program Success. 
Have Been Deapnst rated? 

In addition to performance and other data analyzed elsewhere 
in this report, the evaluators sought other indicators of 
progranmatic success. In so doing, we have focused on three 
additional indicators of achievement: cultural awareness 
experiences, curriculum development and in-service training. 

During the three years of implementation of the project, 
many cultural experiences were organized. Not the least of these 
was the New Year's celebration that was organized and conducted 
during the second year of the project by Vietnamese. Cambodian 
and Laotian parents. This festive occasion included samples of 
traditional southeast Asian dress, dances, customs and cuisine. A 
fuller description of this activity is included in Year Two. 
Progress Report . 

During the third year of the project. administrators 
organized three field visits to the International Classroom of 
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the University MuseuK at the University of Pennsylvania. These 
visits coBbined a guided tour of the Asian Gallery with 
presentations by International speakers froa southeast Asia. 
These visits promoted a better understanding of the cultural 
heritage of the Indochinese students and helped them to adjust 
better to life in the United States. 

As a result of the visits, teachers were asked to complete 
an evaluation fora. rating the tours and presentations, and to 
respond to questions about the quality of the visits. 

The evaluators obtained copies of the foras completed by the 

five pauticipating teachers and reviewed them. Ail five teachers 

found the tours and presentations to be "very satisfactory" or 

"satisfactory". They also reported that the visits had fulfilled 

their objectives and expectations. One teacher commented: 

"My students were very excited about what they heard 
and saw at the University Museum. They toid those students 
who were unable to attend how interesting the visit was and 
also much of the information they had learned. * 

Another teacher commented: 

'(My students) became more aware of the culture of Indo- 
china and can better appreciate some of the problems faced 
by new immigrants. They were very excited and full of 
questions when we returned to class," 

Still another teacher coamented: 

" Students were able to hear accounts of another Indo- 
Chinese culture and adjustment problems. These students were 
fascinated by the Buddhist Gallery tour. Some of the Indo- 
Chinese students were able to 'show and tell' to the other 
students about Buddhist beliefs and artifacts." 

Readers are referred to the appendixes of this report for a 
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fuller description of the prograas offered by the International 
ClassroOB of the University Museu« at the University of 
Pennsylvania. 

In addition to the cultural experiences, title vil project 
curricuIuB developers created three new resource guides during 
the inpleaentatlon of the project. During the first year, a new 
resource guide was developed to assist Indochinese LEP stuc'ents 
with the course. "Social and Legal Education". During the 
second year, a new resource guide was developed to assist these 
students with U.S. history courses. Finally, during the third 
year of the project, a new resource guide was developed to teach 
these students about the culture and history of southeast Asia, 
specifically Vietnam. Cambodia and Laos. Some of these resource 
guides were observed by the evaluators during thfir monitoring 
visits to the title vii project schools, and teachers commentpd 
on their value when instructing indochinese LF.P students. An 
outline of the resource guide designed to teach about the culture 
and history of southeast Asia has been included in thp appendixes 
to this report. 

Finally, during thf three years of project implementation, 
adaiinistrators and staff have drawn on the expertise of 
Georgetown University's Bilingual Education Service Center 
Information about the in-service workshops conducted during the 
first two project years is contained in the Year One Progress 
Report and Year Two Progress Report, 
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During the 1986-87 project year, a series of in-service 
workshops and technical assistance visits were conducted. Topics 
included "ESL, Content and Cognition" and "ESL Strategies in the 
Content Area". Reaction to these workshops was very favorable 
with near unanimity among the project staff that the objectives 
of the in-service were achieved. 
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Evaluative Question #9 - To What Extent Have the Title VH 
Services and Activities Been Perceived as Effective by Project 
Staff? 

Although empirical data on participation, persistence and 
retention, promotion, and performance and achievement data are 
important indices of programmatic success, they are not the only 
such indicators. Project satisfaction and other subjective data 
are also Judged to be important indices of achievement. 

In order to obtain Information about project satisfaction 
and perceptions about the success and effectiveness of the title 
vii project, a brief questionnaire was developed and distributed 
to project and school district staff who were considered to be 
knowledgeable about the project and from whom pertinent data 
could be obtained. The following groups were included in the 
survey: regular classroom teachers in the schools where there 
were Indochinese students who participated in the project. 
biiingual/ESL teachers who teach Indochinese students, 
instructional assistants, school administrators in the project 
schools, and community/school coordinators. Although thought was 
given to including parents of project participants as well as the 
participants themselves, it was decided that these groups would 
not be included because of the logistical problems in translating 
the survey instrument and the administration cf the survey. 
Experience in dealing with Indochinese parents has shown that 
such a survey must be administered as an interview, on a one-to- 
one basis, in order to achieve satisfactory results. Similarly. 




because of the language barrier, it was determined that the 
nature and structure of the questionnaire would be difficult for 
younger Indochinese students to co«prehend. As a result, these 
two important segnents of the project- population were onitted. 
and readers are advised that this limitation -iists. 

Another limitation exists. As with many supplemental 
projects, title vii is often confused with an array of other 
services and activities provided to the Indochinese population. 
To overcome this, a brief descriptor was provided in the 
beginning of the questionnaire. The extent to which the 
descriptor was successful in having respondents adequately 
separate the title vii project from other similar programs cannot 
be judged. Consequently, the reader is advised that respondents 
may have provided information on services and activities not 
directly relatable to those funded by title vii. 

Design and Implementation of the Questionnaire 

The questionnaire was designed to elicit perceptions of 
project effectiveness to achieve several stated and implied 
objectives inherent in the project. Additionally, it sought to 
obtain information concerning the project's effectiveness in 
improving cultural awareness among school district teachers and 
staff and In helping Indochinese students to master English. 

A number of potential factors which mar contribute to 
project success were provided, and respondents were asked to 
indicate the extent to which they did or did not contribute. 



Inforaatlon about workshops /training sessions was sought and 
respondents were encouraged to indicate how effective these 
workshops/training sessions were in contributing to the welfare 
of the project. 

Finally, because parents of participating students were not 
directly included in the study and because it is believed their 
perceptions are iaportant to the overall success of the 
evaluation effort, one question was included in the survey about 
how respondents believed parents would have responded if given 
the opportunity. The evaluators understand the difficulty 
inherent in this exercise: however, teachers and aides and, to 
sone degree, school and district administrators have the closest 
contact with parents of aay groups in the schools. Therefore, 
while it would have been far aore desirable to survey the parents 
themselves, this was deemed to be neither feasible nor practical. 
The next best thing, therefore, was to survey those who were in 
the best position to understand what parents might be thinking. 
Readers are advised, however, of this limitation of the research. 

Th? survey identified a universe of twenty-six individuals 
who could contribute to the survey. Because the universe was 
small and aanageable. the decision was made to survey ail twenty- 
six individuals. Fifteen surveys were returned, which amounted 
to 58» of the respondents. While no formal follow-up on non- 
respondents was conducted, a review of the returned survey 
instruoents suggested that non-response, generally speaking, was 
evw-nly distributed across the five population groups surveyed. 
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Because it appears that all respondent groups were generally 
represented and because the non-respondents did not represent a 
single population, the evaluators determined that there was no 
reason to believe that non-response bias would influence the 
results of the research. 

The distribution of the respondents is shown below. 



Type of Respondent 


N 


Percentage 


Regular classroom teacher 


4 


27^ 


Biiingual/ESL teacher 


3 


33% 


Instructional assistant 


2 


13% 


School/district administrator 


3 


20% 


Community/School f lordinator 


1 


7% 


TOTAL 


15 


100% 



Survey Findings and Conclusions 

There seems to be general agreement by all the respondent 
groups that the title vii project has been effective in serving 
Indochlnese Halted English proficient students. The tabulations 
of responses to this and other questions are provided below. 

As a preface to the discussion of the findings to be 
presented in the paragraphs which follow, readers are advised 
that the percentages shown in the data tables are predicated on 
saall numbers and inferences drawn from such data may not be 
statittically valid. Reuders are further advised that while a non- 
53 
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response analysis of specific survey questions, and iteas within 
questions, suggests that such non-response did not introduce any 
bias Into the interpretation of the data, this nay not be true. 

The data resultant from the survey are provided below 
according to the questions that were asked. 




Question: HOW EFFECTIVE HAVE THE SERVICES AND ACTIVITIES BEEN IN- 
HELPING INDOCHINESE LIMITED ENGLISH PROFICIENT STUDENTS TO ? 

Not Soaewhat Moderately Very 

Effective Effective Effective Effective 



improve Enslish language 
(speaking) proficiency 

iiprove ability to read 
in English 

iaprove ability to write 
in English 

iaprove ability to do 
aatheaatlcs 

earn higher grades overall 
in school subjects 

improve school attendance 

improve ( Indochinese) students' 
attitudes toward school 

Improve (Indochinese) attitudes 
toward other (non- Indochinese) 
students 

develop a more favorable 
self-concept 

improve ability to live and 
work in American society 



7% 



1% 



7\ 



14% 



29% 
20% 

1% 

13% 
23% 
13% 



43% 

30% 

30% 

53% 

57* 
27* 

40* 

34* 
31* 
34* 



50* 

43* 

29* 

47* 

14* 
53* 

53* 

53* 
46* 
53* 



As the above data -indicate , ail (100*) of the respondents 
believed the project was "moderately effective" or "very 
effective" in helping Indochinese students to improve their 
ability to do mathematics. Ninety-three percent (93*) of the 
respondents believed the project was "moderately effective" or 
"very effective" in: (a) improving English language (speaking) 
proficiency, (b) improving their ability to read in English, and 



ERIC 



55 

(30 



(c) improving their attitudes toward school. 

The probleas of overall school perforaance. attendance, and 
student self-concept continue to be recoffnized. Nearly a third 
{29%) of the respondents thought that the project had been only 
"soaewhat effective" in helping Indochinese students to earn 
higher grades overall in school subjects {only 14* of the 
respondents believed the project was "very effective" in 
achieving this). Twenty percent [20%) of the respondents 
believed the project had been only "soaewhat effective" in 
improving school attendance, and nearly one-quarter (23*) of the 
respondents believed that the project had been only "soaewhat 
effective" in helping students to gain a more favorable self- 
concept . 

There was general agreement aaong the respondents that the 
project had been effective in iaproving cultural awareness aaong 
school district teachers and staff. Forty-seven percent (47*) of 
the respondents believed the project's services and activities 
had been "very effective" in this area: 33* believed the project 
had been "moderately effective"; 20* believed it had been 
"soaewhat effective". All (100*) of the respondents believed the 
project had been effective in helping Indochinese students to 
master English. 




Question: HOW IMPORTANT DO YOU FEEL THE FOLLOWING FACTORS HAVE 
BEEN IN CONTRIBUTING TO THE SUCCESS OF THE PROJECT? 



Does Not Not Sonewhat Moderately Very 

Apply Important Important Important Important 



administrative 

leadership 13* 

instructional 
assistants 

community school 
coordinators 

parent participation 

tutoring program by 
Indochinese high 
school students 1% 

workshops and training 7% 

cultural materials 
about the Indochinese 
populations 

general classroom 

climate 7* 

classroom teachers 

district bilingual 
and/or ESL staff 



7% 

13* 
13% 

1\ 



13% 

7% 

33% 
40% 

33% 
13% 

13% 
7% 



26% 

26% 

20% 
13% 

27% 
20% 

33% 

20% 
13% 



48% 

60% 

33% 
33% 

27% 
60% 

54% 

66% 
87% 

100% 



These data show that there was unanimous (100%) agreement 
among ell respondents that the district's bilingual/ESL staff was 
"very important" in contributing to the success of the project. 
Similarly, all respondents agreed that classroom teachers were 
"moderately important" of "very important". A majority of the 
respondents further felt that the following factors were "very 
important" of "moderately important": instructional assistants 



(86»), workshops and training 80%). cultural materials (87*). and 
general classrooiH cliaate (86%). 

ihat is Bost interesting about thes^ data is the fact that 
fflore than half of the respondents- I53») felt that parent 
participation was "not important" or "sonewhat important". This 
is interesting in light of conflicting data that suggest that 
parent participation is one of the essential elements in the 
recipe for student success. For example, when asked in another 
question to rate, in order of priority, the three most important 
factors contributing to project success. the majority of 
respondents indicated that regular classroom teachers were the 
single most important factor. District bilingual/ESL staff were 
rated as the second most important factor. and parent 
participation was rated the third most important factor. 

Eighty percent (80*) of the respondents reported that they 
had attended workshops for educating Indochinese students: each 
reported an average of 2.6 workshops. For those responding in 
the affirmative. information was sought regarding the 
effectiveness of the workshops or training sessions 
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Question; HOW EFFECTIVE WERE THE WORKSHOPS AND TRAINING SESSIONS 
YOU ATTENDED IN ? 

Not Somewhat Moderately Very 

Effective Effective Effective Effective 

helping to iaprove staff 
knoMledge and appreciation 

of Indochinese cultures 56fc 44% 

helping to Introduce better 
teaching methods for 

Indochinese students 8% 33* 59* 

helping to introduce a 
wider range of cultural 
materials into the 
education process for 

Indochinese students 8% 17% 50% 25% 

helping to better understand 
some of the unique problems 
faced by Indochinese 
students 



42% 58% 



h«»lping to integrate second 
language teaching techniques 
with subject/grade level 

curriculum ^0% 50% 

helping to influence 

curricular change 25% 50% 25% 

With the exception of: (a) helping to introduce better 
teaching methods, (b) helping to introduce a wider range of 
cultural materials, and (c) helping to influence curricular 
change, all (100%) of the respondents indicated that the 
workshops were "moderately effective" or "very effective". There 
was not. however, unanimous agreement that the workshops were 
"very effective" in any one single area. 

As indicated in an earlier subsection, parents were not 
included in this survey, however, respondents were asked to 
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provide inforaation on how they believed parents would respond. 
Readers are again advised of the limitations of these data. 



Question: HOW DO YOU THINK THE SERVICES AND ACTIVITIES OFFERED 
BY THE DISTRICT FOR INDOCHINESE STUDENTS ARE RECEIVED BY THE 
PARENTS OF THESE STUDENTS? 

Not Somewhat Moderately Very 

Positive Positive Positive Positive 

understanding the 
schools better 

understanding better 
what their children 
learn 

understanding better 
how to get social 
services 

understanding English 
better 

making friends with 
other parents 

understanding Aaerican 
society better 



The responses received to this question were generally 
distributed across all possible categories. There was general 
agreement that parents, believed the project had been at least 
"somewhat effective" in better understanding school and social 
issues. However, some respondents believed that the project had 
not helped parents to understand English better, to make friends 
with other parents, or to understand American society better. It 
is Important to note here that the project did conduct ESL 
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23% 54% ZZ% 

16% 34% 50% 

27% 36% 36% 

9% 18% 56% 18% 

16% 42% 25% 16% 

8% 42% 33% 16% 



classes for Indochinese parents during its first two sumiers of 
inpleaentation. Moreover, the Diocese of Caaden has operated for 
a nuaber of years a resettleaent prograa for Indochinese 
refugees. and many Indochinese parents are taking English 
language injtruc^lon as part of that prograa. 

These responses indicate an ambivalence between 
billngual/ESL teacher and instructional assistant respondents, on 
the one hand, and regular classroon teacher and school /district 
adninistrator respondents on the other. The former group, the 
data suggest, believe that the services and activities are 
perceived by parents as "soderately" or "very positive". The 
latter group, however, believe the project is perceived by 
parents as "not positive*" or soaewhat positive". 

When asked to suggest ways to increase parent participation, 
respondents indicated: 

o meetings should be carried out in the native language. 

o home/school visitors should visit the home to explain the 
school's program and to notify parents of district staff's 
willingness to help, 

o student presentations, displays, learning fairs should be 
held often to encourage parents to come to the school. 

o a community group could be organized where southeast 
Asians could share their concerns, and 

o more parent/teacher meetings and parent workshops should 
be held. 

It should be noted here that increasing parent participation 
is something that the project staff have striven for since the 
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project was first iapleaented. It has been an enduring proble«. 
however, for a variety of reasons, not the least of which is the 
difficulty that has been experienced in recruiting and retaining 
qualified coamunity-school coordinators fluent in the Indochinese 
languages. 

These findings, when analyzed with data concerning the 
degree of importance of parent participation, suggest that the 
issue of parent participation needs further exploration. This ia 
especially true in light of a vast body of coapelling evidence 
that parent participation in education is iaportant for success. 

At the conclusion of the survey, respondents were urged to 
make connents about the project. The following were reported: 



o "The project has been successful. We should feel proud that 

students are passing the MBS/HSPT The tutoring progran 

has been effective." 

o "The pull-out part of the program hurts the students because 
it takes thea away froa reading and math in the regular 
classroom. It also hurts their acceptance by other students. " 

o "(The program is) "...an unqualified success. However, the 
effectiveness of the program could be enhanced by rearranging 
the schedules so that the Indochinese teacher could assist the 
regular classroom teacher in the presentation of reading and 
math." 

o "Good teachers (strong in both cultures) should be hired." 

o "The Indochinese program is extremely important for the 
students. . .These students need a smooth transition from one 
language culture and customs into another. The Indochinese 
program teacher provides this necessary background. ' 

o "Inservlce training should be provided on a regular basis. " 




SuMary 

These survey data provide a strong indication that the 
project was successful- There was general agreement that the 
title vll project was effective in meeting its objectives. This 
is evidenced by the high percentages of respondents who rated the 
project as "very effective' or "moderately effective". 
Instructional staff, both bi lingual/ESL and regular classrooa 
teachers. were considered to be especially important in 
contributing to the project's success. Survey respondents further 
felt that the inservice workshops and training sessions were 
effective in strengthening the project. Finally, respondents 
agreed that parents seemed to have gained a better understanding 
of the schools, what their children were learning and how to get 
the social services *:ht*y needed. While these respondents 
represent only a small sample of edurators. their opinions are 
not without merit. Consequently, it is reasonable to accept their 
opinions as evidence of project effectiveness. 

A copy of the questionnaire used in the survey is included 
in the appendixes to this report 
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ScCTION THREE 
CONCLUSIONS AND RECOMMENDATIONS 



3.1 Conclusions 

1. Fro» the point of view of its raanageraent and administration, 
the project was successful. The services and activities that were 
planned, with the exception of the native language counseling 
cosponent, were i»pieiaented on a tiiely and effective basis. One 
problem, however, that continued to persist was the difficulty in 
recruiting and employing suitably qualified native Indochinese 
teachers or non- Indochinese teachers fluent in the native 
languages. This difficulty was especially felt in the 
instructional assistants and the community school coordinators 
coaiponents. Nonetheless, the administration of the project was 
successful and the project administrator and the instructional 
staff are to be coauiended. 

2. Indochinese LEP students served by the title vii project 
appear to have increased their ability to read and understand 
English grammatical sentences. This is evidenced by a continued 
increase in percentages of items answered correctly on the ESL 
Marano Test of Passive Grammar. There is less evidence of this 
based on data resultant from the New York Language Assessment 
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Battery. This is due primarily to the difficulty experienced in 
analyzing New York LAB data because of revisions to the teat 
instruacnt, perforaance objectives, ainiaua standards, and the 
way in which suaaative data was displayed. However, the number rf 
students who were mainstreamed to regular classrooms is testimony 
to the English language proflcency of the Indochinese LEP project 
students. Such students must perform satisfactorily on a number 
of test instruments, including the New York LAB and the CTBS. 
before they are aainstreaaed. Moreover, the high percentages of 
student promotion and graduation strongly suggest that 
Indochinese LE? students are achieving English language 
proficiency. 

3. The performance objective for improvement in reading and 
language (writing) was achieved. Indochinese LEP students served 
by the title vii project have demonstrated improvement in reading 
and language (writing). Not only have pre/post gains, as measured 
by the appropriate subtests of the CTBS. been registered in 
nearly every grade, but also the Increases in 1986-87 have been 
substantially greater than the gains reported a year earlier in 
1985-86. 

A cohort analysis, by grade, suggests that the services 
provided to title vii project participants is having a positive 
effect. Except in a few instances, the cohorts have demonstrated 
increases in NCE pre/post gains between 1985-86 and 1986-87. the 
only years for which sufficient data were available for analysis. 
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4. The perforosnce objective for iiproveaent in coaputationai 
skills was achieved. Indochinese LEP students served by the title 
vli project have deaonstrated improvenent in computational 
skills. Pre/post gains in nearly all grades were registered both 
in 1985-86 and in 1986-87. Unlike the scores registered in 
reading and language, however, where the increases in pre/post 
gains were larger in 1986-87 than in 1985-86. the gains in nearly 
all aathematics subtest ».reas were generally saaller in the third 
iear of the project (1986-87) than they were in the second year 
U985-86) . It is iaportant to note, however, that the aath scores 
were generally higher than the reading and language scores and. 
therefore, the potential for growth was liaited. 

5. Technically, the objective for the Miniaua Basic Skills and 
High School Proficiency Tests was not achieved. Seventy- five 
percent (75») of the Indochinese LEP students did not achieve a 
passing grade in reading, math and writing. Nonetheless, there 
was evidence of progress toward this objective. Nearly 45* of the 
participating students passed at least one of the subtests, and a 
nuaber of students were within a point or two of passing. 

6. The perfaance objective for achieving progess toward 
earning high school diplomas was attained. Over 97* of all 
participating Indochinese LEP students in grades 6-12 were 
proBOted to the next higher grade, were aainstreaaed to a regular 
classroom or were graduated during the three years of project 
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i»ple«entation. Moreover, the Indochinese LEP students in grades 
K-5. though not served directly by the project, showed a 
siallarly high percentage of pro»otions/i»ainstreanis. Eighty five 
percent (85*) of the K-5 Indochinese LEP students in the district 
were pronoted to the next higher grade or were mainstreaaed to a 
regular classroo* during the period froa 1984-1987. 

7. The 1986-87 CTBS data in reading and mathenatics that are 
available for Indochinese LEP and Hispanic LEP students were 
reviewed and analyzed. These data suggest that Indochinese LEP 
students are performing better on the CTBS reading and 
matheaatics tests than their Hispanic LEP counterparts. The 
differences that are indicated in the data, however, may be the 
result of some intervening variables that are not possible to 
control, and. therefore, may not be staitistically significant. 

8. Cultural awareness activities, curricular developments, and 
in-service training were important factors in assessing overall 
programmatic success. These activities appear to have helped to 
bridge the cultural gaps that exist among the participants and 
the project staff and to mitigate some of the adjustment problems 
Indochinese parents and students face. 

9. The title vii project has been well received by project staff, 
amonc whom there is general agreement that the project objectives 
have been achieved. This is evidenced by the high percentages of 
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respondents who rated the project as "very effective" or 
"■oderately effective". Instructional staff, both bilingual /ESL 
and regular classrooa teachers were considered to be especially 
inportant in contributing to the project's success. Respondents 
to the research survey felt that the workshops and training 
sessions were effective in strengthening the project. Finally, 
there was agrteient that parents of Indochinese I'^l' »' idents 
seened to have gained a better understanding of the schools, what 
their children learn in school, and how to get the social and 
health services they need. 



3.2 Recomnendations 

In offering reconuaendations for project success and progress 
toward overall goals and objectives, some of the recommendations 
below repeat those made in earlier evaluation reports. This 
should not laply that these recommendations went unheeded: 
rather, thay are repeated because they continue to be relevant 
for the project's success. 

1. Trend data on its three years of implementation suggest 
that the title vii project has been successful. Consequently, the 
structure, objectives and methodologies of the project should be 
maintained without significant change. However. project 
administrators and staff should remain vigilant to new 
information, approaches and materials that may benefit the 
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project or offer opportunites for new and iaproved learning 
experiences. 

2. In organizing parent activities, every atteapt should be 
aade to eiininate obstacles to parent invoiveaent. Parents should 
be encouraged to participate in school activities, and provision 
of services like transportation and babysitting would facilitate 
their participation- 

3. Cultural experiences, especially native Indochinese 
speakers and trips to exhibits and nuseuas. should be continued 
and. to the extent possible and practical, expanded. Trips seea 
to stiaulate the students to ask wore questions and to share 
their experiences with each other. This helps to increase 
cross-cultural sensitivity among all ethnic groups, particularly 
Minority groups, and helps Indochinese students to adjust better 
to life and society in the United States. 

4. CurriculuB development and adaptation should be 
continued in areas found to be most relevant by school district 
staff. 

5. Pe»»r tutoring should continue to be e.'.cou'-aged . Not only 
do these ences given high school students the opportunity 
to reinforce subject matter for themselves and their tutees. but 
they also serve as recognizable role models for the elementary 
and middle school students. 
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BILINGUAL EDUCATION PROGRAM 
SECONDARY ENTRY-EXIT CRITERIA-POINT SYSTEM 



Note: Students need a minimum 
of 60 points to exit the 
proqfam 



New York LAB 
English Proficiency 
Listening - Speaking 
Reading - Writing 


Fts. 


4 


8 


12 


16 


20 


24 


28 


32 


Raw Score 
6th - 8th 
grades 


I - 14 


15 - 29 


30 - 44 


45 - 59 


60 - Tk 


75 - 88 


89 - 104 


105 - 139 


Raw Score 
9th - 12th 
grades 


1 - 16 


17 - 33 


34 - 50 


51 - 67 


68 - 84 


85 - 101 


lOI - 118 


119 - 139 








CTBS - Form U 
Reading (English) 


Pts . 


J 
H 


0 


1 1 


10 


ii) 




28 


32 




NP 


1 - 4 


5-8 


9-12 


13 - lb 


17-20 


21 - 24 


2 5 - 49 


50 - 99 




















CTBS - Form U 


Pts. 


2 


4 


6 


8 


10 


12 


14 


16 


Math (English) 


NP 


1 - 5 


6 - lU 


11 - 15 


16 - 20 


21 - 25 


26 -39 


40 - 49 


50 - 99 




















Scholarship 
Final Grade 
Average: 

English 

Math 

Social Studies 
Science 

ERIC ^ ^ 


Pts. 






8 


U 


14 


17 


20 




Final 
average 






F 


D 


C 


B 


A 
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INTERNATIONAL CLASSROOM OF THE UNIVERSITY MUSEUM 
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International Classroom 

Kas six programs 
for your scKool 



InteiMtHHuH la^snHtm of THC UNIVtltSITY MUSEUM of Anhmok^y/AnllMropohgr UnivifMl> i>/ /Vnmy/vanu i inlH Spruiv biv PhiUtklphutJ'A WKM tJI',! H^m4iH,^ 



Iniematkmai Speaker 
Wsffs 

the School 

IntvnulHmj} SfH\ikvrs. in Ihv svWna ui v<u/r mw 
cldi,\nHmh >h,m' ihfu i uhuit^, on .wi inhnni.il .if ui 
pt'fMHM/ iusiN vvi(/i >iiuf stmh'n(\ lhunit;}i If.uh 
ttonal muMt. Mliku t\ « hHlunn (Luh .in«/ 

caunlrit'%. 




mrld: 
Ancient 
and Mothm 



A visit to Thv Dnm^rsfty Musoum i u/iifii/wv .i 
guidtnl tfMf oi\i musvum i^illvfs w ith j iHvsvnlh 
tkm by an InlvntaUiHul Sfnutkvr Imm thv c owxUy 
Of lulturv bvinfi \tuiimi I in* hHrffulu^htl 
Speaker di%iUbws "nnnkHn" lik* in hisfhvr < ouncry, 
cmlrd%tmg n with the "urn r /h' Jsfnn is ot thv i /v 
HiMatkm ieprvsv^ntvii m ihv nMlvry h^nrnjl r\fH* 
fiem es, im luding Unul) hii\ nhn Jtnm ar I m/ 
tiislums are sharvd. 




CbtssnHHn 
Cultural Consultant 
Fmgrams 



i vssiully Aiiiustrd ffi ihvir mnv Invs in {hvUniH ii 

I hjih^h lliii'm V. ihiUHHi fi» Hini imn »in iutins 
.i/iWC uliufAl i imsulUinh in mvj sihtn^s \\%nkin^ 
ilmm^h ihv \t h<Mi/\ ihv i u^Ium/ ( nfi>u/lJ/if% 
.MMv/ innWv jrriM^I ivlUiiiH' < hihhvn, tUu/ f/it'u 
uuwiivs in thvit ailiu>tmvnt la '\mvfiidn i iiJfun\ 
,in<i fu «*i/ci< jfion.il sfi'/yi wfl^» iv/iii h l/ii*> .iff 




Special 

International Programs at 
Tlw University Museum 



llsinti artisin , manual ami spt^aking skills ot tin* 
InivrnMional SfH*akvrs, varitws ti^}il s m i ulturt*s 
are exphrvd in ik^Hh through a H^ries i>< vwrUs in 
a "SiHKial Day ' at f/w* Vniversity Musi uni "S|h*^ 
i lal Days" luiye Imhvi fm*si*nled on AtniJ (Hlai k 
HistiHyandHeri^ge DayK India, lhaitand. Latin 
Anwru a, the Middle last and I skimos. i )r, a 
"S^)tH mI Pay" lour or livv c lasH*s tun fjartn ifMte 
l()|}t»f ht-r in a wnie sariety ol wents 




Intergenerational Workshops 
with 

International Families 



<ii/<iiuiii,iM }i.illv!\ htut >tuih'nh si>iUn}ithv 
nuisnnn mhi'I wiih an Inlvinalnpiui lainily Inm 
Ihv i itltun it ^ft*^vniiHlin thv ^ialh'f) Ihnninh 
intra uniil\ iluhf^uv ami inlrMi tupn with the 
MMlin}* slmtvnts, lanuls liH* is vsi^hni^l and 
vspLunt d Sinnlantivs in aiul dittvn*iu v> lupin 
\niviH an lanuls hit* an* hi^hh^hUHl 
lUivnh and ^lamlfuivnls ynui ^fl«A'/lC^ aiv 
vin iiiiM^t i/ fo atlvnd and junn ifhHv in thi^ 
iihitfiH' iiio};iani 

1 1» I i^'f ' 




Gallery 
Tours 



Ihv Ihmvisits Musvunt lunisvs niai^nilit ifil hpI 

noijN ol an haviflu^ii al ami iihiHPiifai>liii male 
nah Ihv fH'tmanvnt i ollvi tntns an* auawvnted 
<i> Juinninavshihits i aiidvilliHirs i^l Iht* 
MuH*um's fiallvnes i an Ih» auain^^l thnmuh iIh' 
I dm JfHin Ih'iufinient lot s< hmtl and adult 
tirotips iU^lepluHiv: H'^H 4UJ'^i) 

I »t^i ^hf l*\ n snh'tits 
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f ftriMfl fj^^******!! rfh' I J.is-riH>ni liM« fn'f .in</ .in fr»r» nM 



Typii ill M bf^Uilr Jof W4ifW. Anrhnt and 
Mmhm or an Intergem'ratmnal V^^tfistH^K 

10;(MV 1 1 no CuhIihI four i >> .i n.>l!i'fv 

12.CM) !:tM) lnt<Mn.itif m.li S|MMkrf ih lannK 
1 :fK) PiogMfii iMnK 
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International Classroom 
has six pn^rams 
for your school 



Unique Programs 

for 

Expanding Global 
Perspectives 



_ _ 

/ IntcmatKmal Cta*sm<wn\ 

fa^ 1^ THE UNI*^TY MUSOJM 
of AtichMohgf^An^njpokmr 

Unimshv of flmmy/vania 
SfmKe Streeii 
PhiLithlfibia, m WKM 
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South East Asian History & Culture 

Viet Nam, Cambodia, i Laos 

I. History 

A. Migration 

B. Government and Politics 

1. Dyrasties/ Kingdoms 

2. Foreign domination 

^' Domestic dorr, .nation 

4. Independenre 

5. U.S. Involvement, Viet Nam War 

6. Communistic control 

C. Political leaders 

D. Economy 

II. Geography 

A. Location 

B. Aiea 

C. Population 

1. settlement 

2. density 

3. distribution 

0. Climate 

E. Physica. Features 

F. Agricultire 

III. Ethnicity 

A. Comparison to Nationality 

B. Problems 
e. Groups 

Q D. Traits '^^ 
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IV. Resettlement 

A. Migration 

1. Reasons frr 

B. Refugee Camps 

1. Living Conditions 

2. Locations 

3. Social Services 

C. Process of lT.mi:?rat i :n CJ.S.) 

1. agency T.cdel 

2. volunteer model 

3. naturalization 

4. adoption 

D. Problems 

1. health conditions 

2. separation from family 

3. language 

4. discrimination 

5. emplcyment 

6. adaptation to culture 

V. Customs, Traditions and Beliefs 

A. Family Life 

1. Social customs 

2. Taboos & mores 

3. Holidays and ceiebracions 

4. Education 

B. Religion 

Q C. Art/ music or 

ERIC 

D. Dress 



VI. Language 

A. Origin and Development 

B. Kinds 
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SURVEY QUESTIONNAIRE 




DIVISION OF CURRICULUM AND INSTRUCTION 
BILINGUAL EDUCATION DEPARTMENT 

CAMDEN CITY SCHOOLS 
1 656 Kaighn Avenue • Camden, New Jersey 08 103 
Telephone (609 ) 541-1181 

DR. MARY A. FRAZIER MR. JOSE A. JIMENEZ 

Assisiani Superintendent Director 



TO: 
FROM: 



Ms. Linda J. Sheedy'/i ^'^ 



Supervisor /Title VII Indochinese Project Director 




THRU: Mr. Jose' A. Jimenez 
Director of Bilingual 

RE: Title VII Indochinese Biljrfifual Education Questionnaire 

DATE: May 29, 1987 

Enclosed is a questionnaire to evaluate the Title VII Indochinese project 
which has been operating since the 198A-85 school year in three (3) schools: 
Woodrow Wilson High School, East Camden Middle School and Cramer Elementary 
School. In addition, one (1) 5th grade class from McGraw Elementary School has 
been included in the project since they were re-located from Cramer to McGraw 
during the fall of 1986. 

Your responses to the enclosed questionnaire will greatly assist both the 
Title VII external evaluators and the local administrators in evaluating the 
effectiveness of the Title VII project components and in planning for project 
activities for the 1987-88 school year. Please feel free to add any comments or 
suggestions which go beyond the specific questions included here. 

In order to meet both federal and local time-lines, I vrould appreciate your 
prompt response to the questionnaire. Please return the completed questionnaire 
to the Bilingual Office, c/o Ms. Linda J. Sheedy, by Friday. Ju ne 12. 1987. 

I would also like to take this opportunity to thank you for your 
participation in and cooperation with the Titl^ VII project activities. Your 
dedication is a vital component both to the success of the project and to the 
education of our Indochinese students. 



hdn 

xc: Dr. Mary A. Frazier 
Mr. Herbert Factor 
Mr. Michael Hailey 
Mr. Richard Macrina 
Ms. Lynn Johnson 
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Tirii vi: iNiocHiNEsz 3:-:n*g*ja:- es-jcation' program Questionnaire 



Direct ioris 

This questionnaire nas beer developed to hei? the Camden City 
school" district collect irforraation about the supplemental project 
entitled, "laorovmg £ng:.ish language Proficiency and Curriculum 
Achievement in 2nglish of Indochlnese limited English Proficient 
Students in Grades 6-12". 

We value the information you can provide v*>ry highly. Please taice 
a few minutes to answer tne following questions. It is not important 
that we icnow vour name, but, m order to better understand your 
arswe-s, we would aooreciate icnowing the genera- population group to 
which you belong. We appreciate your taking the time to respona to 
this auestionnaire. 



i. How woulQ you nest describe yourself^ (Mark or. .y one answer 

regular classroom teacher in the district 

oi lingual or ZSl teacner 

instructional assistant 

curriculum developer s f or the Title VIT project specifically 

school or district administrator 

communitv school coordinator 
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von Tr2 FOLLOWING QUESTIONS, PL2ASE TRY TO KHEP THE TITLE VII 
INDOcklNESE 3Ili:^^GUAL PROJECT IN MIND" WHEN YOU RESPOND. IF YOU ARE 
UNABLE TO COME TO A CLEAR DISTICTION BETWEEN THE TITLE VII PROJECT 
AND OT-SR SERVICES AND ACTIVITIES THAT THE DISTRICT PROVIDES TO 
PROMOTE ENGLISH LANGUAGE PROFICIENCY AND CURRICULUM ACHIEVEMENT FOR 
INDOCHINESH STUDENTS. PLEASE TRY TO KEEP IN MIND THE SERVICES OFFERED 
BY INSTRUCTIONAL ASSISTANTS, COMMUNITY SCHOOL COORDINATORS, PARENT 
TRAINING AND HIGH SCHOOL TUTORS FOR INDOCHINESE STUDENTS ONLY WHEN YOU 
ANSWER THE FOLLOWING QUESTIONS. 

2. How effective have the services and activities been in helping 
Indochinese limited English proficient students to: (circle the response 
that best describes your response) 

Not Soraevjhat Moderately Very 

Effective Effective Effective Eff??ctive 



improve Snglisn language 
(speajcing) proficiency 

improve ability to read 
in English 

improve ability to write 
in Er.glisn 

improve ability to do 
mathema-z ics 



earn higher grades overall 
in school subjects 

imorove scnool attendance 



1 
1 



2 
2 



3 
3 



4 
4 



improve (Indochinese) students' 
attitudes toward school 

improve ( Indochinese) attitudes 
toward otner ( non-Indocnmese ) 
students 

develop a more favorable 
self-concept 

improve ability to live and 
work in A:nerican society 
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3 Kow effective have the services and activities been in improving cultural 
awareness among school district teachers and staff? {Mark only one answer) 

Very Effective 

Moderately affective 

Somewhat Effective 



Not Effective 



4 Do vou feei that the services and activities that are provided for 
Indochinese jtudents have been effective in helping them to master 
English? 

Yes No 

5. How important do you fee. the following factors nave been in contributing 
to the success of the project? (Mark only one response for eacn question) 

Does Not Not Somewhat Moderately Very 
Aooly Important Important Important Important 



administrative 
leadership 



instructional 
assistants 



community school 
coordinators 



parent 

oart icioation 0 



tutoring program 
by Indochinese 
high school 
students 



workshops 

and training 

cultural materials 
about the Indo- 
cninese popu- 
lations 



general classroom 
climate 



3 
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classroom teachers 

district oi lingua- 
ar.d/or ^Sl staff 
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6 If you had to select the three most important (in order of priority) 
contributing factors to a successful project, what would they be? (Use the 
list in question #5 above or think of other factors that you feel 
contributed to the success of the project.) 



1st most 
2nd nost 
3rd most 



important 
important 
important 



7. Did you attend any workshops or trair-ing sessions for educating 
Indochinese students? 

Yes ^° 

If you answered "Yes" . now many workshops or training sessions did you 
attend? 



8. How effect 've were the worksnops or training sessions you attended 
(Circle the most appropriate response) 

Not Somewha* Moderately Very 

Effective Effective Effective Effective 



helping to improve staff 
know:. edge and appreciat ior. 
of Indochinese cultures 



helping to introduce 
better teaching metnods 
for Indochinese students 



helping to introduce a 
wider range of cultural 
materials into the 
education process for 
Indochinese students 



helping to better 
understand some of the 
unique problems faced 
by Indochinese students 



helping to integrate 
second language teaching 
techniques with subject/ 
grade level curriculum 



helping to influence 
curricular change 



3 



4 



9. Kow do you think the services and activities offered by the district for 
Indochinese students are received by the parents of these students? 
(Circle the most appropriate response) 



Not 
Positive 



Somewhat 
Positive 



>5oderateiy Very 
Positive Positive 



understanding the 
scnools better 

understanding better 
what their children 
learn 

understanding better 
how to get social 
services 

understanding English 
better 

making friends with 
other oarents 



understanding American 
societv oetter 



lu. Do you have any suggestions for increasing parent involvement in this 
oro ject? 



Please use the following space to offer any cor.n^e^ts you wish to ma<e 
about the project. 
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